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(54) AN IMAGE PROCESSOR, A GAME MACHINE USING THE IMAGE PROCESSOR, A METHOD 
OF IMAGE PROCESSING AND A MEDIUM 

(57) This invention was devised in order to aeate a 

favourable playing environment in a video game by nc 3 

automatically providing an optimum viewpoint without 

placing a burden on the player. 

In an image processing method whereby images, 
wherein the figure of a character and the figure of a 
peripheral landscape set in a virtual spatial coordinates 
system are viewed from a prescribed viewpoint, are 
generated, and image display signals corresponding to 
these images are output, there are provided: a view- 
point calculating step 81 for determining a second point 
on said peripheral landscape which is at a prescribed 
horizontal distance from a first point previously set 
inside the character; a line of sight calculating step 82 
for determining the line of sight by linking the first point 
and the second point by means of a straight line; a view- 
point calculating step S3, for setting as the viewpoint a 
point on the line of sight which is at a prescribed dis- 
tance from the first point; and a drawing step S4 for 
obtaining an image viewed from this viewpoint 
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Description 
TECHNICAL FIELD 

5 This invention relates to an image processing device for displaying images whereby central figures or peripheral 

figures set in a virtual spatial coordinates system are viewed from a certain viewpoint, a game machine using this 
processing device, an image processing method and a medium. 

BACKGROUND ART 

70 

With the progress in computer graphics technology in recent years, data processing devices such as video game 
machines and simulation machines have become commonly used. A video game machine, for example, is provided 
with peripherals, such as game pads, joysticks, a monitor, or the like, and a game main bit containing a CPU which 
implements image processing, sound processing, data communications with the peripherals, and the like. Image 
75 processing in video game machines is extremely important in terms of raising the value of the product, and therefore 
technology for reproduction of animated images has also become highly advanced in recent years. For example, games 
involving stereoscopic three-dimensional {3D) image representations, rather than two-dimensional images, have come 
to be widely played, and highly advanced image processing is conducted in games of this kind. 

In cases where graphics for game screens are created by means of 3D calculation in order to display three-dimen- 
20 sional images, the representation of images of the game field or player's characters located therein depends greatly on 
which viewpoint the three-dimensionally created objects are to be observed from. For example, if the viewpoint is set 
directly to the side of a character, then in the terms of the 3D game, this will produce a "side view", and if the viewpoint 
is set to directly above a character, then this will correspond to a "top view". 

Since the display device used in a video game is a two-dimensional cathode ray tube, it is inevitably difficult to per- 
25 ceive distances in the front-back direction with respect to the screen. Therefore, it a common technique to set a view- 
point such that, of the three-dimensional coordinate axes. X. Y and Z. a coordinate axis wherein detailed perception of 
distance is not required in relation to the contents of the game is set in the front-back direction, namely, perpendicular 
to the front plane. 

For example, in a 3D shooting game, as shown in Fig. 14, enemies and missiles approach from in front and the 
30 player's craft has to avoid these enemies and missiles by moving up and down, and left and right. In this case, the player 
moves in the up and down direction and left and right direction and these directions are therefore very important. On 
the other hand, the front-back distance is of little relative importance. Therefore, in a 3D shooting game of this kind, the 
two-dimensional screen is set in the up-down and left-right planes, whilst the front-back plane is set perpendicular to 
this. 

35 In this way, in a 3D shooting game it is not especially an impediment if the line of sight is fixed in a forward direction, 

but there exist other types of game. For instance, in a game where the player controls a character to fight with oppo- 
nents, or in a game where the character has to break through various obstacles, there are cases where the coordinate 
axis in which a detailed perception of distance is required may change depending on the shape of the landscape in 
which the character operated by the player is moving, or the player's own preferences or skill level. In other words, it is 

40 not possible to create an appropriate playing environment using only a single type of viewpoint. 

Technology corresponding to this is represented by a "virtual button". This is a device whereby a desired viewpoint 
is continually selected from a plurality of prepared types of viewpoint, in accordance with the player's individual prefer- 
ences. 

However, using a "virtual button" has a disadvantage in that it adds an "operation for changing the viewpoint" to the 
45 original game operation, and therefore makes the game operation more complex. Furthermore, since the player has to 
look for the optimum viewpoint him or herself, it obstructs his or her concentration on playing the game. 

This invention was devised in order to overcome problems of this kind, an object thereof being to provide an image 
processing device whereby an optimum viewpoint is automatically provided, thus creating a favourable game environ- 
ment, without burdening the player, and a game machine using this image processing device, an image processing 
so method and a medium whereon programs for same are recorded. 

DISCLOSURE OF THE INVENTION 

In an image processing device, which generates images wherein a central figure and peripheral figures set in a vir- 
55 tual spatial coordinates system are viewed from a prescribed viewpoint, and outputs image display signals correspond- 
ing to these images, the image processing device relating to this invention comprises focal point calculating means for 
determining a second point on the peripheral figures on the basis of a first point previously set with respect to the central 
figure, line of sight calculating means for determining a line of sight on the basis of the first point and the second point. 
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viewpoint calculating means for determining the viewpoint on the basis of the first point and the line of sight, and image 
signal generating means for generating the image display signals corresponding to the image viewed from the viewpoint 
in the direction of the line of sight 

A virtual spatial coordinate system is used, for example, in the type of game where a game field is created by 3D 
5 calculation, and the player controls a character within that game field. "Central figure" refers to the character being oper- 
ated by the player, for example. "Peripheral figures" refers the landscape, buildings, obstacles etc. surrounding the char- 
acter, and in a fighting game, or the like, it also includes opponent characters. 

The first point may be set, for example, inside the character's head, or the like. In this case, the line of sight will 
appear natural to the player. However, the first point does not have to be set inside the character, but may also be set 
10 outside the character, for instance, above the character's head. 

The second point may be set. for example, on the surface, inside or outside the landscape at a prescribed distance 
from the first point. 

The line of sight is, for example, a straight line linking the first point with the second point. 

The viewpoint is set. for example, in a position on the line of sight on the opposite side to the second point, at a 
75 prescribed distance from the second point. 

Furthermore, in the image processing device relating to this invention, the focal point calculating means determines 
a point on the peripheral figure which is at a predetermined first distance from the first point, and sets this point as the 
second point. 

The first distance may have a fixed value, or it may be selected or changed according to circumstances, Further- 
20 more, the first distance is a distance in the horizontal plane, for example. 

Moreover, the image processing device relating to this invention determines the first distance in accordance with 
the movement of the central figure. 

For example, if the character is moving quickly, then the first distance is set to a large distance such that a broad, 
field of view is obtained by looking into the far distance, whereas if the character is moving slowly, the first distance is 
25 set to a small distance such that near objects can be viewed in detail. 

Furthermore, in the image processing device relating to this invention, if a moving figure is included in the periph- 
eral figures, then the focal point calculating means sets a point corresponding to the moving figure as the second point. 

A moving figure may be. for example, an opponent character in a fighting game. The second point may be set. for 
example, inside the opponent character's head, or the like. However, the second point does not have to be set inside 
30 the opponent character, but may also be set outside the character, for instance, above the character's head. 

Furthermore, in the image processing device relating to this invention, the viewpoint calculating means determines 
a point on the line of sight which is at a predetermined second distance from the first point and sets this point as the 
viewpoint. 

The second distance may have a fixed value, or it may be selected or changed according to circumstances. The 
35 second distance may be a distance in three-dimensional space or it may be a distance in a horizontal plane. 

In the image processing device relating to this invention, the second distance is taken as a distance in a horizontal 
plane, coordinates which are at the second distance from the first point projected in this horizontal plane are deter- 
mined, these coordinates are set as the horizontal plane coordinates of the viewpoint, and the viewpoint is determined 
on the basis of these horizontal plane coordinates, and moreover, a maximum value for the distance between the first 
40 point and the viewpoint is determined, and if this maximum value is exceeded, the viewpoint is determined such that 
the distance between the first point and the viewpoint does not exceed the maximum value, regardless of the second 
distance. 

If the second distance is taken as a distance in the horizontal plane, then the viewpoint may be set in an unnaturally 
distant position from the first point, depending on the angle of the line of sight, and therefore a maximum value is pro- 
45 vided such that it is not distanced by more than a certain value. 

In the image processing device relating to this invention, the second distance is determined in accordance with the 
size of the central figure. 

For example, if the character is large, or if there are a plurality of characters, the second distance is set to a large 
distance, so that all of the characters can be seen, whereas if the characters are small, or there is only one character, 
50 then the second distance is set to a short distance. 

The game machine relating to this invention is provided with any one or the image processing devices described 
above, and the central figure is taken as the figure of a gee character, and the peripheral figure is taken as the figure of 
a landscape. 

In an image processing method whereby images wherein a central figure and peripheral figures set in a virtual spa- 
55 tial coordinates system are viewed from a prescribed viewpoint are generated, and image display signals correspond- 
ing to these images are generated, 

the image processing method relating to this invention is such that a second point on the peripheral figure is deter- 
mined on the basis of a first point previously set with respect to the central figure, a line of sight is determined on the 
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basis of the first point and the second point, the viewpoint is determined on the basis of the first point and the line of 
sight, and the image display signals are generated corresponding to the image viewed from the viewpoint in the direc- 
tion of the line of sight. 

Furthermore, the image processing method relating to the present invention is such that, if the central figure is 
5 taken as the figure of a game character, and the peripheral figure is taken as the figure of a landscape, an image is gen- 
erated in an upward -looking line of sight when the landscape in the direction that the character is facing is high, and an 
image is generated in a downward -looking line of sight when the landscape in the direction that the character is facing 
is low. 

Moreover, the image processing method relating to the present invention is such that, if the central figure is taken 
10 as the figure of a game character, and the peripheral figure is taken as the figure of a landscape and an opponent char- 
acter, then an image is generated in a line of sight from the character towards the opponent character. 

BRIEF DESCRIPTION OF THE DRAWINGS 

75 Fig. 1 is a general oblique view of a video game machine incorporating an image processing device according to a 

first mode for implementing this invention; 

Rg. 2 is a block diagram of a video game machine incorporating an image processing device according to a first 
mode for implementing this invention; 

20 

Rg. 3 is an approximate flow-chart of image processing in a first mode for implementing this invention; 

Rg. 4 is a diagram for describing the principles of a method for determining the camera position in a first mode for 
implementing this invention (viewed from side); 

25 

Fig. 5 is a diagram for describing the principles of a method for determining the camera position in a first mode for 
implementing this invention (viewed from above); 

Fig. 6 is a diagram for describing an example of a method for determining the camera position in a first mode for 
30 implementing this invention (viewed from side); 

Rg. 7 is a diagram of a screen displayed according to a first mode for implementing this invention; 

Rg. 8 is a diagram of a further screen displayed according to a first mode for implementing this invention; 

35 

Rg. 9 is a diagram of a further screen displayed according to a first mode for implementing this invention; 

Fig. 10 is a diagram for describing a method of determining a camera position in a third mode for implementing this 
invention; 

40 

Fig. 11 is a diagram of a screen displayed according to a third mode for implementing this invention; 
Fig. 1 2 is a diagram of a further screen displayed according to a third mode for implementing this invention; 
45 Rg. 1 2 is a diagram of a further screen displayed according to a third mode for implementing this invention; 

Rg. 13 is a diagram of a further screen displayed according to a third mode for implementing this invention; and 
Rg, 14 is an illustrative diagram of a camera position in a shooting game. 

50 

BEST MODE FOR CARRYING OUT THE INVENTION 
First mode of implementation 

55 Below, a preferred mode for implementing the present invention is described with reference to Fig. 1 - Fig. 9. In this 
mode of implementation, a case where an image processing device according to the present invention is applied in 
video game machine is described, 

Rg. 1 shows an external view of a video game machine relating to a mode for implementing this invention. In this 
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diagram, symbol 1 indicates a video game main unit. Two connectors 2a are provided on the front of a video game main 
unit 1. and peripherals 2b such as game pads for controlling the game are connected respectively to these connectors 
2a via cables 2c. Furthermore, a cartridge interface (l/F) la for connecting a ROM cartridge and a CD-ROM drive lb 
for reading a CD-ROM are provided on the upper portion of the video game main unit 1 . Although not shown in the dia- 

5 gram, a video output terminal and audio output terminal are provided on the rear side of the video game machine. This 
video output terminal connects to the video input terminal of a TV receiver 5 via a cable 4a. and the audio output termi- 
nal connects to the audio input terminal of a TV receiver 5. In a video game of this kind, by operating the peripherals, 
the user is able to play a game whilst watching the screen displayed on the TV receiver 5. 

Fig. 2 is a block diagram showing an overview or a video game machine relating to a mode of implementing this 

10 invention. This video game machine comprises a CPU block 10 for controlling the device as a whole, a video block 11 
for controlling the game screen display, a sound block 12 for generating sound effects, and the like, and a subsystem 
13 for reading a CD-ROM, and the like. 

The CPU block 10 comprises an SCU (System Control Unit) 100, main CPU 101, RAM 102. ROM 103. cartridge 
l/F la, sub-CPU 104, CPU bus 105, and the like. The main CPU 101 controls the whole device. This main CPU 101 

15 comprises an internal calculating function similar to a DSP (Digital Signal Processor), which is omitted from the draw- 
ings, and it is capable of implementing applicational software at high speed. 

The RAM 102 Is used as the work area for the main CPU 101. Initial programs and the like used for start-up 
processing are written into the ROM 103. Reciprocal data input and output between the main CPU 101 , VDP 120, 130, 
DSP 140, CPU 141, and the like, is conducted smoothly by controlling the buses 105, 106 and 107, 

20 The SCU 100 comprises an internal DMA controller, and is capable of transferring character data (polygon data) 

relating to the game to the VRAM in the video block 11. Thereby, the applicational software for the game, or the like, 
can be implemented at high speed. 

The cartridge l/F la serves to input applicational software supplied in the ROM cartridge format. 

The sub-CPU 1 04 is called an SMPC (System Manager & Peripheral Controller), and it performs the function of col- 

25 lecting peripheral data from the peripherals 2b via the connectors 2a in Fig. 1 . according to the requirements of the main 
CPU 101 . The main CPU 101 performs image control, such as rotational conversion or perspective conversion of the 
characters In the game screen, for example, on the basis of the peripheral data supplied by the sub-CPU 104. The con- 
nectors 2a can be connected to desired peripherals, such as game pads, joysticks, keyboards, or the like. The sub-CPU 
1 04 automatically identifies the type of peripheral that is connected to the connectors 2a (main unit terminals) and it per- 

30 forms the function of collecting peripheral data and the like in accordance with the communications system correspond- 
ing to that peripheral type. 

The video block 1 1 comprises a first VDP (Video Display Processor) 120 which draws polygon screens ascribed to 
characters and background images consisting of polygon data in the video game, and a second VDP 130 which draws 
scroll background screens and performs image synthesis, clipping, and the like, of polygon image data and scroll image 
35 data on a priority (display priority order) basis. 

Of these, the first VDP 120 contains a system register 120a and is connected to the VRAM (DRAM) 121 and two 
screen frame buffers 122, 123. Polygon drawing data representing the characters in the video game is transferred from 
the main CPU 101 via the SCU 100 to the first VDP 120. and it is written into the VR/\M 121. TTie drawing data written 
in to the VRAM 121 is. for example, transferred into a drawing frame buffer 122 (or 123) in a 16 or 8 bit/pixel format. The 
40 data stored in frame buffer 122 (or 123) is transferred by the second VDP 130 when the device is in display mode. 

On the other hand, the second VDP 130 contains a register 130a and a colour RAM 130b, and is connected to the 
VRAM 131. Furthermore, the second VDP 130 is connected via bus 107 to the first VDP 120 and the SCU 100, and it 
is also connected via a memory 132 and an encoder 160 to a TV receiver 5. 

Scroll image data for the second VDP 1 30 is defined by the main CPU 1 01 in the VRAM 1 31 and colour RAM 1 30b 
45 via the SCU 100. Information for controlling the image display is similarly set in register 130a of the second VDP 130. 
The data defined in VRAM 131 is read out by the second VDP 130 in accordance with the contents set in the register 
130a, and it forms image data for each scroll screen representing the background relating to the characters. The image 
data for each scroll screen and the image data for polygon data supplied from the first VDP 120, which has been texture 
mapped, are assigned a display priority order (priority) according to the setting in register 130a, and they are synthe- 
50 sized into the final display image data. 

If this image display data is in a pallet format, the second VDP 130 reads out the colour data defined in the colour 
RAM 130b according to the values therein, and generates display colour data. If the display Image data is in RGB for- 
mat, the image display data is taken directly as display colour data. This display colour data is stored in the memory 
132 and the output to the encoder 160. The encoder 160 generates a video signal by appending a synchronising signal, 
55 or the like, to this image data, and outputs this video signal to the TV receiver. By this means, a game screen Is dis- 
played on the TV receiver. 

The sound block 1 2 comprises a DSP 1 40 which synthesizes sound by means of a PCM system or FM system, and 
a CPU 141 which controls this DSP 140. and the like. Sound data generated by the DSP 140 is converted to a two- 
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channel signal by a D/A converter and then output to two speakers 5a, 

The sub-system 1 3 comprises a CD-ROM drive lb, a CD l/F 180. MPEG AUDIO 182. MPEG VIDEO 183. and the 
like. This sub-system 13 performs the function of reading out applicational software supplied in CD-ROM format, or the 
like, and reproducing animated pictures, or the like. The CD-ROM drive 1b inputs data from the CD-ROM. A CPU 181 
5 controls the CD-ROM drive 1 b and conducts error processing and the like on the input data. The data read from the CD- 
ROM is supplied via the CD l/F 180. bus 106 and SCU 100 to the main CPU 101, and it is used as applicational soft- 
ware. The MPEG AUDIO 182 and MPEG VIDEO 183 are devices for restoring data compressed according to MPEG 
(Motion Picture Expert Group) standards. By restoring MPEG compressed data contained on a CD-ROM by means of 
the MPEG AUDIO 182 and MPEG VIDEO 183 in this way. it is possible to reproduce animated images. 
70 The user places a CD-ROM, which forms the medium on which programs are stored, into the CD-ROM drive lb. 
and when a prescribed operation is performed, the contents of the CD-ROM are read out and supplied to the main 
memory{RM 102 etc.) The CPU 101 performstheactionsof the first mode for implementing the invention, as described 
beiow. in accordance with the downloaded program. 

Apart from a CD-ROM, media which may be used in the first mode for implementing this invention include, for 
75 example, a floppy disk, hard disk, magnetic tape, optomagnetic disk, DVD, ROM cartridge, RAM memory cartridge with 
battery back-up. flash memory cartridge, fixed RAM cartridge, or the like. 

Furthermore, a wired communications medium, such as a telephone circuit, or a radio communications medium, 
such as a microwave circuit, may also be used. The Internet is included in this definition of communications media. 

A medium is a entity whereby information (mainly digital data and programs,) can be recorded by a physical means 
20 of some kind, and it is able to cause a processing device, such as a computer, special processor, or the like, to imple- 
ment prescribed functions. In brief, it should enable programs to be downloaded into a computer by some means or 
other, thereby causing the computer to execute prescribed functions. 

Next, the operation of a mode for implementing this invention is described. 

When the viewpoint is determined in a three-dimensional game (3D game) implemented a device as shown in Rg. 
25 1 and Fig. 2, in general, a "camera" is envisaged, and the direction in which this "camera" is pointing and the spatial 
coordinates that it is occupying are set. The image taken by this "camera" is then displayed on a TV screen. In other 
words, this "camera" represents the player's line of sight. Accordingly, the line of sight adopted by the "camera" is 
extremely important to the player's ability to control the game, and it is necessary to carry out optimum viewpoint adjust- 
ment. 

30 Optimum viewpoint adjustment refers to the direction whereby the most desirable image for the player is obtained. 
For example, in a 3D shooting game, enemies and missiles approach from in front and the player's craft has to avoid 
these enemies and missiles by moving up and down, and left and right. In this case, the player moves in the up and 
down direction and left and right direction and these directions are therefore very important. On the other hand, the 
front-back distance is of little relative importance. Therefore, in a 3D shooting game of this kind, the two-dimensional 
35 screen is set in the up-down and left-right planes, whilst the front-back plane is set perpendicular to this. In other words, 
the optimum line of sight for the player is a fixed line of sight facing fonwards. 

However, in a game where the player controls a character which moves through a landscape, there are cases 
where the coordinate axis in which a detailed perception of distance is required may change depending on the shape 
of the landscape in which the character operated by the player is moving, or the player's own preferences or skill level. 
40 In other words, unlike the case of a 3D shooting game as described in the example above, it is not possible to create 
an appropriate playing environment using only a single type of viewpoint. 

For example, if the player is going to leap over a ravine, he or she needs to gain an accurate perception of the width 
of the ravine and the direction in which to leap. Therefore, a viewpoint looking downwards is desirable. 

If the player needs to avoid missiles coming from in front or him or her. then a viewpoint looking forwards is desir- 
45 able, as described above. 

The first mode of implementing the present invention automatically conducts optimum viewpoint adjustment by 
referring to the relationship between the player's character and the landscape in a process known as "camera coordi- 
nates and angle determination". 

In the description below, the viewpoint is determined on the basis of the character in a game. This is because in an 
50 action game, for example, the direction in which the character performs actions, such as moving, attacking, or the like, 
is defined as the forward direction, and the player concentrates mainly on the forward direction when playing the game. 
If the player wants to perform an action in a different direction, the player should turn the character to face in the desired 
direction. Therefore, it is possible to maintain convenience in terms of game playing by changing the viewpoint only with 
respect to the forward environment. 
55 The details of processing are now described using specific examples, with reference to Fig. 3 - Fig. 9. 

Firstly, as shown in Fig. 4 and Fig. 5, the point in front of the player is defined as A (xA, yA, zA), a desired point 
inside the player (for example, a point in the head region,) as B (xB, yB, zB), the camera position, as C (xC, yC, zC), the 
orientation of the player in the XZ plane, as 8Y, the horizontal distance between reference point A and reference point 
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B in front oi the piayer in the XZ plane, as dHAB. and the distance between reference point B and reference point C. as 
dBC. Point A is a point on the surface of the landscape. If the angle formed between the straight line ABC and the hor- 
izontal plane is taken as a, then the relationship dHAB = dAB.cosa is formed. The distances dHAB and dBC are deter- 
mined previously such that an optimum view is obtained when the program is actually run, and these values are stored 

5 in the memory by reading out the game software. 

The first point B is set inside the character based on the general premise that in games where the player's character 
is displayed, the player will play the game by operating that character. In other words, it satisfies the following two crite- 
ria : (1) that the character must be on the screen in order to proceed with the game; and (2) that the operations required 
by the player are determined by the relationship between the character and the landscape. 

10 Next, the operation is described using the flowchart in Rg. 3. 

Step SI : Calculating focal point 

When the character Ch has moved to a position, firstly, the point on which that character is focusing is calculated 
75 The coordinate set 8 (xB. yS, zB). direction eY, and the distance dHAB are given. 

Firstly, in the X2 plane, the coordinates A (xA, zA) relating to the XZ axis of reference points are derived on the 
basis of the coordinates B (xB, zB) for the character Ch, the direction eY in which the character Ch is facing, and the 
distance dHAB. As shown in Fig. 5. these coordinates are the coordinates in the XY plane of the point on which the 
character Ch is focusing. If the character Ch is facing forwards, (direction of z axis in Fig. 5). then 
20 A (xA, zA) = B (xB, zB + dHAB) . Furthermore, if the character Ch is facing in direction OY. then 
A (xA, zA) = B (xB + dAB.sinO Y, zB + dAB.cosOY) (where the angle formed between the direction in which the char- 
acter Ch is facing and the 2 axis is taken as GY.) 

In this way, firstly, if coordinates A can be determined in the XZ plane, then they can be determined regardless of 
the state of the landscape (height of the landscape), and processing is relatively simple. 
25 Coordinates A (xA, zA) determined in this way do not give consideration to landscape data in the Y axis direction, 

and therefore three-dimensional landscape data is referred to in order to obtain an actual focal point on the landscape. 
In other words, the device searches for point A (xA. yA. zA) corresponding to coordinates A (xA. zA) from the three- 
dimensional landscape data. 

30 Step S2 : Calculating line of sight 

Taking point A (xA, yA, zA) derived in step 81 as a starting point, a straight line (line of sight) passing through point 
B (xB, yB. zB) is determined, the two points are given, then the elation of the straight line can be derived readily. Step 
S3 : Calculating camera position 
35 Next, the camera position C (xC, yC. zC) is derived. 

The distance dBC between reference point B and the camera position C is previously determined, as described 
above, and it is constant. Therefore, coordinates C (xC, yC, zC) are set using the linear elation derived in step S2 such 
that the distance between reference point B and camera position C is dBC. 

40 Step S4 : Drawing 

A screen is drawn taking the camera position C (xC, yC, zC) derived in step S3 as the viewpoint. Thereby, an image 
containing the character Ch and the landscape is obtained. 

The processing described above is conducted by the main CPU 101 in Fig. 2. Similar processing can also be imple- 
45 mented in the sub-CPU 1 04. 

The image obtained by means of the above processing is now described using a simple example. 
Fig. 6 shows a sectional view of a landscape. In this diagram, the character Ch operated by the player is moving 
from the right to the left. In this case, firstly, there is an uphill slope (point PI), followed by a flat path (point P2), and 
finally, a deep valley (point P3) (d in Fig. 6 is the same as dHAB in Fig. 4.) The corresponding images displayed are 
50 shown in Fig. 7 - Fig. 9. 

Firstly, Fig. 7 is described. Character Ch is positioned at point PI in Rg. 6. Since the landscape in front is an uphill 
slope, the point on the landscape which is a distance d from point Bl in the horizontal direction. Point CI is on the 
straight line linking point A1 and point Bl. Since point Al is in a higher position than point B1, point C1, which is on the 
other side of point Bl from point Al is in a lower position than point Bl. Therefore, the camera adopts a line of sight 
55 looking upwards and in the displayed image, the horizontal line L will be in the upper portion of the display, as shown in 
Fig. 7. If an image looking upwards in this way is displayed, then the direction in which the character Ch is travelling can 
be perceived readily, and therefore game operation becomes easier. 

Next. Fig. 8 is described. Here, the character Ch is located at point P2 in Fig. 6. The landscape in front of the char- 
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acter is flat, and therefore point A2 is lower than point B2, and point C2 is slightly higher than point B2. Accordingly, the 
camera adopts a line of sight looking slightly downwards and in the displayed image, the horizontal line L approaches 
the centre of the display, as shown in Fig. 8. If an image looking slightly downwards in this way is displayed, then the 
player is able to see into the distance in the direction in which the character Ch is travelling. This line of sight is suitable 

5 in cases where, for instance, the player is trying to avoid missiles approaching from in front. 

Next, Fig. 9 is described. Character Ch is located at point P3 in Rg. 6. Immediately in front of the character there 
is a very deep valley, and the point on the landscape which is a distance d from point B3 in the horizontal direction is 
point A3 on the valley floor. Point A3 is much lower than point 83 and point C3 is higher than point 83. Therefore, the 
camera adopts a line of sight looking almost vertically downwards at a very steep angle, and the displayed image will 

10 be as shown in Fig. 9. In this image, the horizontal line L is not displayed, but lines L1. L2 indicating the sides of the 
valley are displayed. The valley floor is displayed between lines LI and L2. When an image of this kind is displayed, the 
player can see in detail the dangerous terrain immediately in front of the character. A line of sight of this kind is appro- 
priate when the player is leaping over a ravine arxJ needs to assess accurately the width of the ravine and the direction 
In which to jump. 

15 In the description above, the distances between the reference points, dHAB and dBC. had fixed values, which are 

considered from experience to be most suitable values. However, besides this, it is also possible to set a plurality of dis- 
tances which are selected as appropriate, these distances being variable so that the distance values are changed 
according to conditions such as the speed, number, size etc. of the characters. 

For example, the distances can be controlled such that if the character is moving at high speed, in order to look at 

20 a distant point, distance dHAB is set to a long distance, whilst conversely, if the character is moving slowly, it is set to a 
short distance. Normally, if the character is moving quickly along a flat road, the player will look into the distance, and if 
the character is travelling carefully through difficult terrain, the player will look at the landscape close to the character, 
and therefore by controlling the distance dHAB in the aforementioned manner, it is possible automatically to provide a 
natural viewpoint. 

25 Furthermore, the distance dBC can be controlled such that, it there is a single character, dBC is set to a short dis- 

tance, whereas if there is a group comprising a plurality of characters, then dBC is set to a long distance, so that all of 
the characters can be displayed on the screen. By controlling the distances in this way. it is ensured that all the charac- 
ters are displayed on the screen at all times. 

As described above, according to a first mode of implementing this invention, since a viewpoint in 3D space is cal- 

30 culated by referring to the positional relationship between the landscape and a player's character in a game, relatively 
simple processing is possible. 

Furthermore, since the position of the viewpoint can be moved in real time in response to this positional relation- 
ship, which is constantly changing as the player controls the game, it is possible to achieve fine, stepless movement of 
the viewpoint, in contrast to conventional technology which provides only several types of viewpoint. By the change of 

35 screens accompanying this movement of the viewpoint, the player can view the game from the optimum viewpoint at all 
times. For example, if the character is going up a slope, a viewpoint looking upwards is adopted so that a good view of 
the top of the slope is obtained, whilst if the character is leaping across a deep valley, by looking directly downwards, 
the width of the valley can be perceived readily. The appeal of the game graphics is also raised. 

Since the viewpoint is moved automatically, requiring no operation by the player, no extra burden is placed on the 

40 player. 

According to the mode for implementing this invention, since a camera position is determined from a point set 
inside the character, and a focal point in frorit of the character, processing involves only simple calculation, and suitable 
processing can be performed whatever the direction from which the player approaches the landscape. Therefore, it is 
possible to change the viewpoint in real time in response to any given situation. For example, a suitable viewpoint can 
45 be provided even if the character jumps and is in mid-air. If, in contrast to the mode of implementing this invention, the 
point inside the character and the focal point were defined previously, this would involve a huge number of possible 
coordinate combinations, which would not be practicable and would make real-time processing extremely difficult. 

Second Mode for Implementing the Invention 

so 

In the aforementioned first mode for implementing the invention, the viewpoint was determined on the basis of the 
distance dBC between the reference point B in the character and camera position C, but besides this method, the fol- 
lowing type of method is also possible. 

As shown by the dotted line in Fig. 4, here, the viewpoint is determined on the basis of a distance dHBC which rep- 
55 resents a horizontal projection of the distance dBC between the reference point B in the character and the camera posi- 
tion C. In other words, the camera position C is determined by a similar method to the method for determining reference 
point A. 

In this method, if the angle a in Fig. 4 is close to 90** (for example, when the character is at point P3 in Fig. 6 and 
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is looking down into a deep valley), the distance between reference point B and the camera position C is very large (the- 
oretically, it approaches infinity) and is therefore unnatural. Therefore, a maximum value dmax is set such that the dis- 
tance dBC does not reach a certain fixed value (dAB < dmax). 

in specific terms, the following processing is conducted at step S3 in the flowchart in Fig. 3. 

5 

Step S3 : Calculating camera position 

The camera position C (xC, yC, zC) is determined. 

Firstly, the coordinates (xC, zC) of the camera position in the Z plane are determined. The specific method of deter- 
10 mining these coordinates is the same as that used in step S1. The distance is taken as dBC and the direction should 
be reversed. For example. xC = xB , zC = zB - dHBC . 

By substituting the coordinates C (xC, zC) thus obtained into the linear equation obtained in step S2, and solving 
for y. the camera position C (xC, yC, zC) is derived. In this case, the camera direction is from point C towards point A. 
According to this method, processing is required to check the distance to the camera constantly so that it does not 
75 exceeds its maximum value, but a new function is provided in that the distance to the player can be changed to a certain 
degree by means of the camera angle. For example, an effect is obtained whereby, when the player looks into a deep 
valley, the field of view broadens. 

In the description above, the distance dHBC between reference points had a fixed value, which was considered 
from experience to be the most suitable value. Besides this, it is also possible to set a plurality of distances which are 
20 selected as appropriate, the distance being variable so that the distance value is changed according to conditions such 
as the speed, number, size etc. of the characters. 

Third Mode for Implementing the Invention 

25 In the aforementioned first and second modes for implementing the invention, viewpoint C is determined by taking 

the reference point A as a point which is a certain distance in front of the character, but besides this method, if the char- 
acter was fighting with enemy characters, for example, then the coordinates of that enemy could be used as a refer- 
ence. 

This method is now described usir>g Fig. 10 - Rg. 13. 
30 Fig. 10 is a side view of a character Ch and enemy characters Chi - Ch3. The character Ch controlled by the player 
is in the centre of the diagram, and there is an enemy character Chi in front of the character Ch, an enemy character 
Ch2 behind him. arxJ an enemy character Ch3 in the air in front of him. The enemy characters Chi - Ch3 reference 
points A1 - A3 inside them, respectively. Camera positions CI - C3 exist on the extensions of the straight lines linking 
each of these reference points A1 - A3 with reference point B. These camera positions are determined by a similar 
35 method to that used in the first or second modes of implementation. 

The reference points A1 - A3 may be in any position provided that they correspond to the location of the enemy 
characters Ch1 - Ch3. The following exanrples may be conceived. 

The reference points are located at the waist of the enemy character. Since the reference point B is usually located 
near the head portion of the character Ch, then if the reference points A are positioned at the waist of the enemy char- 
40 acter, the camera line of sight will appear to look slightly downwards. Fig. 10 illustrates such a case. 

The reference points are located at the head region of the enemy characters. In this case, the camera line of sight 
looks directly fonward at the enemy characters. 

The reference points are located above the heads of the enemy characters. In this case, the camera line of sight 
appears to look slightly upwards. The reference points may be located outside the characters in this way. This also 
45 applies to reference point B. 

The specific procedure for determining a camera position C from the reference points A and b is the same as that 
used in the first and second modes of implementation. 

Fig. 1 1 shows an example of a screen displayed when the camera position is at CI in Fig. 10. There is an enemy 
character Chi in front of the character Ch and they are facing each other. Since the camera position Cl is slightly 
so above, the image gives an impression of looking downwards and the whole figure of the enemy character is displayed. 

Fig. 12 gives an example of a screen displayed when the camera position is at C2 in Fig. 10, There is an enemy 
character Ch2 behind the character Ch. In this way, even if the character is approached from behind by an enemy char- 
acter, the enemy character is not lost from view and the character is not liable to surprise attacks 

Fig. 13 shows an example of a screen when the camera position is at C3 in Fig. 10. The enemy character Ch3 is 
55 flying in mid-air and the view is looking up this character from below. 

According to the mode of implementing this invention, the direction of the line of sight is not necessarily the same 
as the orientation of the player's character, but the opponents are always displayed on the screen. Furthermore, in a 
fighting game, or the like, since the player continuously has to carry out actions in response to an enemy, according to 
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the mode for implementing this invention, the direction of the line of sight forms a guide for the direction in which the 
character should be facing, thus providing the advantage or raising the player's control of the game. 

As described above, according to this invention, in an image processing device, which generates images wherein 
a central figure and peripheral figures set in a virtual spatial coordinates system are viewed from a prescribed viewpoint. 

5 and outputs image display signals corresponding to these images, since the image processing device relating to this 
invention comprises focal point calculating means for determining a second point on the peripheral figures on the basis 
of a first point previously set with respect to the central figure, line of sight calculating means for determining a line of 
sight on the basis of the first point and the second point, viewpoint calculating means for determining the viewpoint on 
the basis of the first point and the line of sight, and image signal generating means for generating the image display 

JO signals corresponding to the image viewed from the viewpoint in the direction of the line of sight, an optimum viewpoint 
can be provided automatically, thereby creating a favourable game environment. 

According to this invention, since said focal point calculating means determines a point on the peripheral figure 
which is a predetermined first distance from the first point, and sets this point as the second point, it is possible to deter- 
mine the second point by means of relatively simple processing. 

15 According to this invention, since the first distance is determined in accordance with the movement of the central 
figure, the viewpoint can be changed as appropriate in response to the circumstances of the central figure, and a more 
favourable game environment can be created. 

According to this invention, when the peripheral figure contains a moving figure, since said focal point calculating 
means takes a point corresponding to the moving figure as the second point, it is possible to display moving figures on 

20 the screen at all times, and an opponent is never lost from view. 

According to this invention, since said viewpoint calculating means determines a point on the line of sight, which is 
a predetermined second distance from the first point, and sets this point as the viewpoint, it is possible to determine the 
viewpoint by means of relatively simple processing. 

According to this invention, since the second distance is taken as a distance in the horizontal plane, coordinates 

25 which are at the second distance from the first point projected in this horizontal plane are determined, these coordinates 
are taken as the horizontal plane coordinates of the viewpoint, and the viewpoint is determined on the basis of these 
horizontal plane coordinates, and moreover, a maximum value is determined for the distance between the first point and 
the second point, and if this maximum value is exceeded, the viewpoint is determined such that the distance between 
the first point and the viewpoint does not exceed the maximum value, regardless of the second distance, then it is there- 
to fore possible to add a new function whereby the distance between the viewpoint and the player is changed to a certain 
degree by means of the angle of the line of sights For example, when the player is looking into a deep valley, this has 
the effect of broadening the field of view. 

According to this invention, since the second distance is determined according to the size of the central figure, the 
viewpoint can be changed as appropriate in response to the circumstances of the central figure, thereby providing a 

35 more favourable game environment. 

INDUSTRIAL APPLICABILITY 

As described above, the image processing device, game machine using this processing device, image processing 
40 method and medium relating to the present invention are applicable to computer graphics for displaying an image 
whereby a central figure and peripheral figures set in a virtual spatial coordinates system are viewed from a certain 
viewpoint, for example, they are applicable to a system whereby, when determining a viewpoint in a three-dimensional 
game (3D game), whilst in general a "camera" is envisaged and the direction in which the "camera" is pointing and the 
spatial coordinates it is occupying are set. in this process of "determining camera coordinates and angle", the viewpoint 
45 is automatically adjusted to an optimum viewpoint by reference to the relationship between the player's character and 
the landscape. 

Claims 

50 1 . An image processing device, which generates images in which a central figure and peripheral figures sat in a virtual 
spatial coordinates system are viewed from a prescribed viewpoint, and outputs image display signals correspond- 
ing to these images, said image processing device comprising: 

focal point calculating means for determining a second point on said peripheral figures on the basis of a first 
55 point previously set with respect to said central figure, line of sight calculating means for determining a line of 

sight on the basis of said first point and said second point, viewpoint calculating means for determining said 
viewpoint for generating images on the basis of said first point and said line of sight, and image signal gener- 
ating means for generating said image display signals corresponding to the image viewed from said viewpoint 
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in the direction of said line of sight. 

2. The image processing device according to claim 1. characterized in that said focal point calculating means deter- 
mines a point on said peripheral figure which is at a predetermined first distance from said first point, and sets this 

£ point as said second point. 

3. The image processing device according to claim 2. characterized in that said first distance is a distance in a hori- 
zontal plane. 

10 4. The image processing device according to claim 2, characterized in that said first distance is determined in accord- 
ance with the degree of movement of said central figure. 

5. The image processing device according to claim 1, characterized in that, if a moving figure Is included in said 
peripheral figures, then said focal point calculating means sets a point corresponding to said moving figure as said 

15 second point, 

6. The image processing device according to claim 1, characterized in that, if an enemy character is included in said 
peripheral figures, then a point corresponding to said enemy character is set as said second point. 

20 7. The image processing device according to claim 1. characterized in that said viewpoint calculating means deter- 
mines a point on said line of sight which is at a predetermined second distance from said first point and sets this 
point as said viewpoint. 

8. The image processing device according to claim 7. characterized in that said second distance is taken as a dis- 
25 tance in a horizontal plane, and said viewpoint calculating means determines coordinates which are at said second 

distance from said first point projected in a horizontal plane, sets these coordinates as the horizontal plane coordi- 
nates of said viewpoint, and determines said viewpoint on the basis of these horizontal plane coordinates, and 
moreover, determines a maximum value for the distance between said first point and said viewpoint, and if this 
maximum value is exceeded, determines said viewpoint such that the distance between said first point and said 
30 viewpoint does not exceed said maximum value, regardless of said second distance. 

9. The image processing device according to claim 7 or claim 8 characterized in that said second distance is deter- 
mined in accordance with the size of said central figure. 

35 10. The image processing device according to claim 7 or claim 8 characterized in that, if said central figure comprises 
a plurality of figures, said second distance is determined according to the number of said plurality of figures or the 
distribution thereof. 

11. A game machine characterized in that it comprises an image processing device according to any one of claims 1 
40 to 10. and said central figure is taken as the figure of a game character, and said peripheral figure is taken as the 

figure of a landscape. 

12. A medium whereon programs for causing a computer to function as said focal point calculating means, said view- 
point calculating means, and said viewpoint calculating means according to any of claims 1 to 10, are stored. 

45 

1 3. An image processing method whereby images in which a central figure and peripheral figures set in a virtual spatial 
coordinates system are viewed from a prescribed viewpoint are generated, and image display signals correspond- 
ing to these images are generated, an image processing method whereby a second point on said peripheral figure 
is determined on the basis of a first point previously set with respect to said central figure, a line of sight is deter- 
so mined on the basis of said first point and said second point, said viewpoint is determined on the basis of said first 

point and said line of sight, and said image display signals are generated corresponding to the image viewed from 
said viewpoint m the direction of said line of sight. 

14. The image processing method according to claim 13. characterized in that, if said central figure is taken as the fig- 
55 ure of a game character, and said peripheral figure is taken as the figure of a landscape, then an image is gener- 
ated in an upward-looking line of sight when the landscape in the direction that said character is facing is high, and 
an image is generated in a downward-looking line of sight when the landscape in the direction that said character 
is facing is low. 
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15. The image processing method according to claim 13, characterized in that, if said central figure is taken as the fig- 
ure of a game character, and said peripheral figure is taken as the figure of a landscape and an opponerrt character, 
an image is generated In a line of sight from said character towards said opponent character. 
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